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Introduction 

Let G / H be a semisimple symmetric space attached to an involution t:G G . Then in order 
for a unitary irreducible representations (7r,7i) of G to be realized in U'{G/H), 1 < p < cxd, 
or more generally in V'{G/H), it is necessary that (7r,7i) is H -spherical, i.e., the space of 
-invariant distribution vectors {Ti,^°^)^ has to be non-zero. 

Two classes of representations in the unitary dual G of G arc of special interest: The 
unitary principal series and the discrete series. For the unitary principal series induced from a 
parabolic subgroup we have for almost all parameters a complete description of [71^°°)^ (cf. 
[Ba88], [0187] for the 0t -stable minimal parabolics and [BrDe92] for the general case). Discrete 
series on G/H were constructed in [FJ80] (see also [MaOs84]) and in [Bi90] it was shown that 
{H^°°)^ is one-dimensional for all discrete series on G/H except for four types of exceptional 
symmetric spaces. Holomorphic discrete series, i.e., unitary highest weight representation of G 
which can be realized in L'^{G/H) were constructed in [0088, 91] (this construction is essentially 
different than the one in [FJ80]) and it was shown that {H^°°)^ is always one-dimensional (this 
also covers half of the exceptional spaces in [Bi90]). 

In this paper we address the problem of classifying all iJ -spherical unitary highest weight 
representations for a simply connected hermitian Lie group G. We write g — i) ® q for the t- 
eigenspace decomposition of g: = Lie(G) and choose a r-stable Cartan decomposition g — t©p. 
Set K: = exp({) . Note that 3(6) is one-dimensional since G is hermitian and that H is connected 
since G is simply connected. Now non-trivial -spherical highest weight representations exist 
if and only if 3(6) C q which means that G/H is compactly causal (cf. [Hi0196]). 

The unitary highest weight representations {t^\,'H\) of G can be parametrized by the 
highest weight A of the corresponding finite-dimensional unitary representation (tt^, F{\)) of K . 
In the scalar case, i.e., dimi^(A) = 1, the classification of unitary highest weight representations 
was accomplished in [Wal79] and [VR76] while the general case has been treated in [EIIW83] 
and [Jak83]. The generahzed Verma module N{\) — U{qc) ®u{ic+p+) ^ highest weight 

module for g with highest weight A. It has a unique irreducible quotient L(A) which is {q,K)- 
isomorphic to the space of -finite vectors of {tt\, Ti,\) . We call A singular if the kernel J(A) of 
the natural map A^(A) —>■ L{X) is non-zero and regular otherwise. 

If {T^x^Ti-x) is spherical, then L{X) trivially is spherical, but the converse is not obvious 
because there is no a priori reason for an f) -invariant linear functional on L{\) to extend to 
a continuous functional on . That this is nevertheless the case follows from [BaDe88] and 
[BrDe92] (see also [Kr99a] for the hyperfunction version). In the light of this result we only 
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have to deal with the question whether L(A) is f) -spherical. It is easy to see that a necessary 

condition is that F{\) is H Ci ii" -spherical. Further elementary considerations show that A'"(A) 
is f)-spherical if and only if F{X) is H r\ iiT -spherical. This already completes the classification 
for all regular parameters. For singular parameters it was first observed in [Kr99a] that the 
condition of F{X) being H n if -spherical is not sufficient by showing that the even metaplectic 
representation of Sp(n, R), n > 2, is not -spherical (see also [KN099, Cor. II. fO]). 

If A is singular, then we can attach to L{X) the level le(A) which is a natural number 
ranging from 1 to at most the real rank of G. Algebraic considerations using the fact that the 
maximal submodulc of A^(A) is cyclic (cf. [DES91]) yield the following half of the classification: 

Theorem II. 8. Suppose that L{X) has odd reduction level. Then {tt\,TCx) is H -spherical if 
and only if F{X) is H (1 K -spherical. 

Besides the algebraic approach to classify -spherical unitary highest weight representa- 
tions one can also attack the problem in an analytic way by using a realization of (tt\, Ti.\), where 
the iJ-action is transparent. In the sequel we assume that G/K is of tube type, i.e., G/K is 
biholomorphic to a tube domain V + ifl with V an euclidean Jordan algebra and Q C V the 
open cone of squares. Then it follows from [HiNe99] that Hx can be realized as an -space of 
i^(A) -valued functions on Q, given by 



where R\ is a certain measure on il with values in the cone Herm (F(A)) of positive operators 
on F{X). We call L'^{il,,Rx) the cone realization of {ttx,'Hx)- The if -action is then given by 



where tx denotes the natural -representation on F{X) associated to the corresponding repre- 
sentation of Kc by a Cayley transform mapping H into Kc ■ The ii' -action however is completely 
invisible in the cone realization L^{n, Rx) . Therefore the following description of the K -Unite 
vectors is surprisingly explicit and simple: 

Theorem IV. 5. The K -finite vectors in L'^{Q,Rx) are given by e"*'' Pol(V, F(A)) Ij^, where tr 
denotes the Jordan algebra trace of V . 

We even obtain a natural identification of A^(A) with the space e~ Pol(V, F{X)) , such that 
the restriction map to L'^{Q, Rx) corresponds to the quotient map A^(A) L{X) . Using Theorem 
IV. 5 and the results of [IIiNe99], we obtain a description of the (up to scalar multiples) unique H- 
invariant i^(A) -valued tempered distribution R^ supported by fl. Now L{X) is spherical if and 
only if R^ vanishes on the maximal submodule J(A) of N{X), realized as e~ Pol(F, F(A)) . 
This requirement leads to the necessary condition supp(i?|'^) C supp(i?A), but unfortunately 
this condition is not sufficient for L{X) to be spherical. Nevertheless, if supp(i?A) is strictly 
smaller than f2, then the information on J(A) and R^^ is explicit enough to obtain the following 
Classification Theorem: 

Theorem V.ll. Let G be a simply connected hermitian Lie group of tube type and (irxj'Hx) be 
a unitary highest weight representation with F{X)^'^^ ^ {0} and supp{Rx) 7^ 0. Then (nx,'Hx) 

is H -spherical if and only if le(A) is odd. 

We will see in Section V that among the singular unitary highest weight representations with 
spherical F{X) the condition that supp(i?A) is smaller than Q. is satisfied in about half of all cases. 
In the scalar case F{X) is always H n if -spherical and A is singular if and only supp(i?,A) 7^ ^■ 
Therefore the Classification Theorem covers in particular the scalar case. It therefore implies 




{■Kx{h).f){x) = Tx{e{h)).f{e{h)-\x) for heHJe L\i},Rx)), 
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that the most singular scalar type highest weight representation which has reduction level 2 is 
never spherical. This covers the even mctaplcctic representation of G = Sp(n, M) . 

In the vector case (i.e. dim F{X) > 1 ) the situation is much more complicated if supp(i?A) = 
fl and A is singular. Here we do not know of any example with even reduction level, where L{\) 
is spherical. 

We conclude the paper with an appendix where we give a simple algebraic proof of the 
fact that parameters A which belong to the relative holomorphic discrete series representations 
of G/ H arc always regular. This means that these representations do not provide any further 
information on the question whether a singular unitary highest weight representation L(A) with 
spherical lowest K-type F{X) is spherical or not. 



I. Generalities on highest weight modules 

In this section we recall some concepts and results related to spherical highest weight modules. 



Hermitian Lie algebras 

Let be a simple real Lie algebra and 6 a Cartan involution of g with Cartan decomposition 
g = 4©p ■ We call q hermitian if }{t) ^ {0} . We now collect some basic facts concerning hermitian 
Lie algebras (cf. [Hel78, Ch. VIII]). The center of t is one-dimensional, i.e., 3(B) = WiZo for some 
/ Zo e We can normalize Zq such that Spec(Zo) = {1.0,-1}. Further, every Cartan 

subalgebra t of 6 is a Cartan subalgebra of g and }{t) C t. Let gc be the complexification of g 
and A the root system of gc with respect to tc • 

A root S G A is called compact if a{Zo) = and non-compact otherwise. We denote by 
Afc , resp. A„ , the set of compact, resp. non-compact roots. We fix a positive system A+ C A 
such that 

A+: = A„ n A+ = {S e A„: a{Zo) = 1}. 
We set p=^: = {X € gc- [Zq, X] = ±X} and note that 

0c = p+eec©p"- 

As Spec(Zo) = {1,0,-1} and Zq £ l{^c), it follows that [tc,p^] C p±, [p+,p"] C t^, 
[p+,p+] = {0} and [p-,p-]={0}. 



Generalized Verma modules 

In this subsection we collect some basic facts concerning highest weight modules from an 
abstract algebraic point of view. References for the fact used in this subsection are [EIIW83] or 
[Ne99, Ch. IX]. 

Let X ^ X denote the conjugation in gc with respect to the real form g . Then the map 
X I— > X*:= —X extends to an involutive antilinear antiautomorphism D ^ D* of U{gc) ■ A 
hermitian form (•, ■) on a gc -module V is called contravariant if 



(VX e gc)(Vi;, weV) {X.v, w) = {v, X*.w). 
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Let A e it* be dominant integral with respect to and write F{X) for the corresponding 

finitc-dimcnsional unitary irreducible tc-niodule. Let q := p"*" x tc and turn F{X) into a q- 
module by letting p+ act trivially. We define the generalized Verma module associated to A 

by 

iV(A)=W(0c) ^u(,) FW- 

Then A^(A) is a highest weight module with respect to A+ and highest weight A which contains 
F{X) as a t-submodule which is called the lowest t-type. Therefore it has a unique maximal 
submodule J(A) and hence a unique simple quotient L(A) := N{X)/J{\). The positive definite 
form on -F(A) has a imique extension to N{X) called the Shapovalov form. The radical of this form 
is the maximal submodule J(A) . In particular, the Shapovalov form factors to a contravariant 
form on L(A) which we also denote by (•,-)a- We call L{X) unitarizable if (•,-)a is positive 
definite on L{X) . 

The canonical mapping Zi(p") ® F(X) N'{X) gives rise to an isomorphism 

U{p-)(8>F{X) ^ N{X) 
of 6c x p~ -modules, where tc x P~ acts on l({p~) (gi F{X) via 

(VXetc) X.{p'Siv):=X.piSiv+piSiX.v 
(Vrep") Y.{p^v):=Yp^v 
for all p G U{p~) and v e F{X) . 



Symmetric structures 

We now endow g with a symmetric structure, i.e., with an involutive automorphism 
T:g—>g. The pair (0,t) is called a symmetric Lie algebra. We write 

l}:= {X e g:T{X) = X} and q: = {X G g: t(X) = -X} 

for the T-eigenspaces and note that = f) © q. We assume that r commutes with the Cartan 
involution 6. 

Definition I.l. A hermitian symmetric Lie algebra (g, r) is called compactly causal, if 
3(6) Cq. ■ 

Remeirk 1.2. For later reference we collect here the basic structural facts concerning compactly 
causal symmetric Lie algebras. Let (g, r) be compactly causal. We denote the complex linear 
extensions of r and to gc by the same symbols. The c-dual {q'^,t'^) of {q,t) is defined by 
g'^: = [) + iq and r'^: = r Igc . Then 0'^: ~ Or defines a Cartan involution on g'^ and we write 
g'^ = F © p'^ for the corresponding Cartan decomposition. 

As (g, r) is compactly causal, we find a maximal abelian subspace a C (iq) n p'^ which 
is already maximal abelian in p'^ (cf. [Hi0196, Prop. 3.1.11]). We write A = A(g'^, a) for the 
restricted root system of g^ with respect to a and write 

r = ae3f,(a)©0(gT 

aeA 

for the corresponding root space decomposition. We now choose the compact Cartan subalgebra 
t of g such that t = (tnf))ffijo. Since 3(6) C q we can choose A+ such that the prescription 
A+:= A+ |a\{0} defines a positive system A+ of A. Similarly we define compact and non- 
compact roots Afe and A„ . Finally we define subalgebras 

(fl')" and n-:= (g^)«. 

QeA+ c«e-A+ 

Note that g'^ = () © a © n+ and 11=*= = p='= n g° . ■ 
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Spherical highest weight modules 

Definition 1.3. (a) If () is a Lie algebra and V a complex a-module, then we write for 
the submodule of V which is annihilated by () . We denote by the algebraic antidual of V , 
i.e., the space of antilinear functionals V ^ C 

(b) If (g, t) is a hermitian symmetric Lie algebra and L(X) an irreducible highest weight module, 
then wo call L{X) spherical if there exists ^ v € L{X)^ which is annihilated by I), i.e., 

Proposition 1.4. If the hermitian symmetric Lie algebra {q, t) has a non-trivial spherical 
unitarizable highest weight module, then (0,t) is compactly causal. 

Proof. [Kr99b, Lemma B.l]. ■ 

Proposition 1.5. Let V be a highest weight module of the compactly causal symmetric Lie 
algebra (g, r) with highest weight A and let v\ denote a highest weight vector. Then 

mc)-vx = V. 

If, in addition, V is spherical, then the lowest tc-type F{X) := {v € V:p~^.v = {0}} of V is 
spherical for {t,T), i.e., F{X)^^^ + {0}. 

Proof. Since (g, r) is compactly causal, the decomposition g'^ = f) © a ® n implies that 
gc = ()c © cic ® nj. Therefore ZY(gc) = U{^<c)U{Oic)U{xC^) by the Poincare-Birkhoff-Witt 
Theorem, and therefore 

y = l{{gc).vx = U{i)c)U{acMn+).vx = U{i)c).vx. 

Now we assume that V is spherical and consider v G (y")'' \ {0}. Then the first part 
implies that {vjVx) 7^ 0. Thus i'\f{x) defines a non-zero I) fl 6-fixed element. ■ 

The following lemma provides some refined information on the ^-module structure of N{X) . 

Lemma 1.6. // (g,T) is compactly causal, then we have an isomorphism of U{{^c) -"modules: 

^([)c) ^^(bcntc) = ^(flc) Ow(tcep+) u®v^u®v. 

Proof. [HiKr98, Lemma 3.1.1]. ■ 

Proposition 1.7. If (g,T) is compactly causal, then the restriction map 

{N{Xff ^{F{X)^f^\ v^v\p^x) 

is a bisection. In particular, dim(A''(A)'')^ < 1 and N[X) is spherical if and only if F{X) is. If 
F{X) is spherical, then L{X) is spherical if and only a non-zero element u G (A''(A)'')'' vanishes 
on the kernel J{X) of the map N(X) — » L{X) . 

Proof. (cf. [HiKr98, Lemma 3.1.2]) This is a direct consequence of Lemma 1.6. ■ 
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II. The classification for odd reduction levels 

We are interested in a description of those unitary highest weight modules L(A) which are 
spherical. In Proposition 1.7 we have seen that it is necessary that F{X) is spherical, and that 
this is sufRcicnt provided that N(\) = L{X) . Therefore the question becomes interesting for the 
situations where the kernel J(A) of the quotient map N{X) — » L{X) is non-trivial. In this case 
we will assign to L{X) a natural number le(A) , called its reduction level. The main result of 
this section is that if le(A) is odd and F{X) is spherical, then L(X) is spherical. This is done by 
analyzing the tc -Fourier series of the spherical vector u of L{X). In the following sections we 
will take a closer look at the cases with even reduction level. 



The classification of unitarizable highest weight modules 

Let g be a hermitian Lie algebra, t C t a Cartan subalgebra, and identify ^(t)* with the 
subspace (tn [6,8])^ C t*. Let ( G 13(6)* C H* be normaHzed by C(7) = 1 for 7 G A+ a long 
root. Fix A° e ii* dominant integral with respect to . For u gM. we set 

A" = A° - uC. 

Further we define 

1{X°): = {u e M: i:(A") is unitarizable}. 

Theorem II. 1. (Enright-Howe-Wallach, Jakobsen) Let X^ G itg be dominant integral with 
respect to A'^ . 

(i) There exists a real number Um such that 

1{X°) = {Uo, Um}Ci\Um, Oo[ 

where Uj = Uo + jf for j = 0, . . . , m and d is the multiplicity of the restricted roots of g 
which are the second longest. 

(ii) For u G Z(A°) we have L(A") ^ A/'(A") if and only ifu>Um- 

Proof. [EHW83, Th. 2.4]. ■ 

The cigcnspace decomposition of the symmetric algebra h{{p^) with respect to the action 
of Zq by derivations yield the grading by homogeneous elements U{p^) — ®^o^(P )"• 
each n G No we set 7V(A)": = W(p-)" (g) F(A). Then 7V(A) = 0^^o^(^)" as tc-modules, and 
(1.1) shows that Zq acts on N{X)'^ by multiplication with X{Zo) — n. 

Definition II. 2. Suppose that A G it* is dominant integral with respect to and let J(A) 
be the maximal submodule of A''(A) . We call A regular if J(A) = {0} and singular otherwise. 
Let ,/(A) = "^(•^)" be the natural grading induced from the one on A''(A) . If A is singular, 

then we call the number 

le(A): = min{n G Nq: J(A)" ^ {0}} 



the level of reduction of L{X) 
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Remeirk II. 3. From the classification of unitary highest weight modules, we know that the 
points uo, • • • ) Um from Theorem II. 1 are related to reduction levels by 

le(A"0 = l+i 

(cf. [EJ90]). So we see that approximately half of the singular points uo,... ,Um correspond to 
even and half to odd reduction levels. ■ 

Theorem II. 4. (Davidson-Enright-Stankc) Suppose that N{\) is reducible and L{X) is 
unitarizable. Then the maximal submodule J{X) is a highest weight module, i.e., there exist an 
element Xj e it* which is dominant integral with respect to such that J(A) = N{Xj) . 

Proof. This follows from [DES91, Th. 3.1]. Note that, since N{X) is a free ZY(p-)-module, 
the maximal submodule J(A) is isomorphic to N{Xj) if Xj is its highest weight. ■ 



Some algebraic criteria 

Let (t: = exp(7riZo) S G. Then the Cartan involution ^ on G is given by 6{g) = <Tga~^ 
for g eG. 

Lemma II. 5. (Parity Lemma) Let N{X) be spherical and v G (A''(A)'')'' be a non-zero spherical 

vector. For n G No we set v": ~ i^|Ar(A)" • Then j/" = for n odd. 

Proof. Since the action of t on A^(A) is locally finite, it integrates a representation of the 
simply connected group K C G. Hence, in particular, a acts on A''(A) in such a way that 

a{X.v) = 9{X).{a-.v) for X G g, v <E N{X) . Since f) is 0-invariant, ly o a = cv for some c G 
follows from (A^(A)*')'''^' = Cv (Proposition 1.7). From v = X^^q i'" and (1.1) we thus get 

oo 

Therefore c = e'"'^'^") and = for n odd. ■ 

From now on we suppose that (fl,T) is compactly causal, that L{X) is unitarizable, and 
that -F(A) is spherical, so that N{X) is spherical by Proposition 1.7. Let Q ^ v ^ {N{X)^)^ . 

Lemma II. 6. // J(A) is not spherical, then L{X) is spherical. 

Proof. If J(A) is not spherical, then v \ = 0. Thus i' factors to a non-zero () -fixed 
antilinear functional on L(X), showing that L{X) is spherical. ■ 

Proposition II.7. Let ^ v G {N{X)^)^ and F{Xj) the highest l-type of J(A). Then the 

following assertions are equivalent: 

(1) L{X) is spherical. 

(2) !^|f(a.) =0. 

Proof. Note that L{X) is spherical if and only if v = 0. We recall from Theorem II. 4 
that J(A) is a highest weight module with highest weight Xj . Thus Proposition 1.5 implies that 
i^|j(A) = if and only if i^\f(\j) =0. ■ 
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Theorem II. 8. (Classification for odd reduction levels) // L{X) ^ -/V(A) is unitarizable and 

le(A) is odd, then L{X) is spherical if and only if F{X) is spherical. 

Proof. If L{X) is spherical, then F(X) is spherical by Proposition 1.5. 

Assume, conversely, that F(X) is spherical. Then iV(A) is spherical (Proposition 1.7), so 
that there exists a non-zero element u e (A^(A)^)'' . In view of Proposition II. 7, we have to show 
that i^\f(Xj) = 0. Since le(A) is odd, this follows from Lemma II. 5. ■ 

Example II. 9. In the following we give an example where both L{X) and J(A) are spherical. 

Let (g, ()) = (sp(n,R),fl[(n,M)). We choose A" = and set A; = A""-i for the first 
reduction point which has reduction level n . Then it follows from [E J90] that the highest weight 
Aj of the maximal submodule J(A) is contained in ii{i)* ■ In particular, F{Xj) is fiflS-spherical. 
Since A is a first reduction point, we have J(A) = N{Xj) . Hence J(A) is spherical by Proposition 
1.7. Further if n is odd, then Theorem II. 8 implies that L(X) is spherical too. More details on 
the composition series of the modules A''(A) in this case can be found in [FaKoQO]. ■ 



III. Realization of representations in spaces of distributions 

In this section we realize simple highest weight modules of the important special case of Cayley 
type compactly causal symmetric Lie algebras in spaces of vector-valued distributions supported 
by a closed convex cone in a euclidean Jordan algebra. For the constructions in this section 
unitarizability will play no role at all. In the next section we will see how this picture can 
be used to get refined information on unitary highest weight modules because in this case the 
corresponding realization by distributions can also be viewed as a subspace of a suitable -space 
with respect to an operator-valued measure. 



Algebraic preliminaries 

Definition III.l. A compactly causal symmetric Lie algebra (0,r) is said to be of Cayley 
typeifm^m- ■ 

Remark III.2. (a) If (f|, r) is of Cayley type, then ^(t)) C [j np and dim3(f)) = 1 (cf [Hi6l96, 
Th. 1.3.11]). 

(b) Cayley type symmetric spaces are classified (cf [Hi0196, Th. 3.2.8]). Up to isomorphy, the 
corresponding pairs (fl, f)) are given by 

(su(n,n),5l(n,C) eR), (so* (4n), su* (2n) M), (sp(n,R),0[(n,M)), 

(so(2,n),so(l,n- 1)©E), (e7(_25) , e6(-26) ® K)- 

(b) If (fl, r) is of Cayley type, then the Lie algebra g is hermitian and of tube type (cf [Hi0196], 
[KoWo65]), i.e., the hermitian symmetric space G/K attached to g is biholomorphically equiv- 
alent to a tube domain Tn = V + ifl over the convex open cone CI of invertible squares in a 
finite-dimensional simple euclidean Jordan algebra V . ■ 

In the following V denotes a simple euclidean Jordan algebra with unit element e and 
CI C V the open cone of invertible squares. Having Remark 111.2(b) in mind, from now on 

G stands for the simply connected covering group of Aut(ro)o and K = {g G:g.ie = ie} 
is the analytic subgroup corresponding to {. The corresponding Cartan involution satisfies 
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ri{g .r]~^ {z)) = 0{g).z for z £ Tq, where r]{z) = —z~^. As a subgroup of G, the group H 
consists of all those elements of G acting by linear maps on Tq . This implies in particular that 
H preserves V and also fi. Geometrically the involution r is determined by ({g.(~^{z)) = T{g).z 
for z &Tq, where C,{z) = —z. Since G is simply connected, the subgroup G'^ is connected, 
hence coincides with H . Let Kc denote the universal complcxification of K . Since Kc has a 
polar decomposition Kc = K exp(it) , this group is also simply connected. 

Definition III.3. (a) We follow the notation of [FaKo94]. We define L{z) e End(Vc) , z^Vc, 
by L{z).w = zw and write 

P: Vc ^ End(yc), z ^ P{z) = 2L{zf - L{z^) 

for the the quadratic representation of Vc ■ Let {ci, . . . , Cr} be a Jordan frame of V (cf. [FaKo94, 
p. 44]) and set e^: = Ci + . . . + Cfe for < A; < r with the conventions eo = and e = Cr- Then 
0. = H-Cr and 

n = OoUOiU . . . \JOr 

with Oj = H.Cj and Oj = Ui^jOi is the i?-orbit decomposition of O (cf. [FaKo94, Prop. 
IV. 3.1]). The mmibcr r is called the rank of the Jordan algebra V. 

Note that [) n8 ^ dei{V) and I) n p ^ {L{x):x G V} (cf. [FaKo94, Th. III.5.1]). Then 
b := (Bj^iRL{cj) is a maximal abelian subspace of f) fip . Define Sj G b* by ej{L{ck)) = Sjk and 
set e: = ■ Then the restricted root system of f) is given by 

S = {|(ej-£i):»7^J,l<*,J<r}. 

We consider the positive system = {-^{sj — e^): i < j}. The coroot corresponding to ^{sj —et) 
is 2[L{cj) — L{ci)). Therefore a linear functional A = is dominant integral, i.e., can 

occur as a restricted highest weight of a finite-dimensional representation of ^ if and only if 

nij - rui € No, i < j, 

which implies in particular that mi < m2 < • • • < m^. For real highest weight representations 
which are the same as spherical representations of H, one has the stronger condition that 
ruj -rriiG 2No for i < j (cf. [HiNe99, App. A] and [Hel84, Th. 5.1]). 
(b) Let 

V={zeVc:I- P{z)P{z) » 0} C p+ ^ Vc 

be the Harish Chandra realization of G/K as a bounded symmetric domain (cf. [FaKo94, Prop. 
X.4.2, Th. X.4.3]). Then the Cayley transform 

aV^Tn, z ^ -i{z + e){z - 

is biholomorphic. 

The universal complcxification Gc of G acts by meromorphic mappings on Vc and qc can 
be viewed as a Lie algebra of holomorphic vector fields on Vc . In this sense the Cayley transform 
can be considered as obtained by an element of Gc , which implies that it induces an isomorphism 
Cg € Aut(flc) mapping the Lie algebra g of Aut(X') onto g. Note that Cg = e'-^^^ for some 
i) n e-fixed element T € q n p with Spec(adr) = {-1, 0, 1} (cf. [Hi6l96]). The subalgebra 1 Cq 
consisting of all vector fields vanishing in is maximal compact, and furthermore we have 



e = (t) n e) © i(() n p) 
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(cf. [FaKo94, Prop. X.3.1, Th. X.5.3]). It follows in particular that ic = f)c and that 6 is a 
compact real form of f)c. Therefore complex f) -modules are equivalent to complex t-modules. 
In addition, we have _ 

« = cg(e) = H)nt)®icg{i)r)p) 

and icg(^ n p) = q n t. We choose a compactly embedded Cartan subalgebra t C g containing 

icg (b) , which is then automatically adapted to the above decomposition of t . We choose a positive 
system A'^ of the corresponding root system Afc = A{tc, tc) such that o Cg |t, C S"*" U {0} . 

If (7r',F(A)) is a highest weight representation of t, resp., tc we obtain a representation 
of t)c = 6c by := tt' o Cg . We call A o Cg |b the restricted highest weight of this representation 
(cf. (a)). 

On the group level the inclusion ^ : I) — > 6c yields the identity on H C\ K . Therefore the 
Cartan decomposition H = {H n K) exp(t) n p) leads to a homomorphism H Kc which, in 
view of the simple connectedness of Kc, is the universal complexification of H , i.e.. He — KcM 



Polynomial differential operators and distributions 

For a finite-dimensional complex Hilbert vector space F, let S^iF) denote the space of 

F -valued tempered distributions on V supported by the closed convex cone fl. For z € Vc 
let Bz'.V ^ C be defined by ez{x) := e'^'"^^ , where (•,•): Vc x Vc ^ C is the complex bihnear 
extension of the scalar product on V . According to Lemma B.l in [HiNe99], for each z € Tq 
and D e ^{F) we have CizD G and e^z \^ extends to a Schwartz function on V , so that 

the Fourier transform J^{D) extends uniquely to a holomorphic function 

J^{D):Ta^F, z ^ D{ei,), 

(cf. [Sch66, Ch. VIII, Prop. 6]). We thus obtain an injective map 

T:SL{F)^Rol{Tn,F). 

For a characterization of the image we refer to [Sch66, Ch. VIII]. Here we will only need that 
this map is injective. 

In the following we will consider the space S'{V, F) = <S'(V^) (S^iV oi F-valued distributions 
as the topological antidual space of S{V, F) , the F-valued Schwartz space, where the pairing is 
given by 

(£> w, y (g) w) := D{(fi){v, w). 

Now we turn to the action of the algebra of polynomial differential operators on these 
spaces. To fix the notation, for w G V we define on C°°{V, F) the operators 

{dv.(p){x) = d(p{x){v) and {mv.(p){x) = {v,x)ip{x). 

It is also clear that End(F) acts naturally on C°°{V, F) by A.ip := Aoip. We write WiV, F) 
for the algebra generated by the operators dy , ruy and End(F) . The elements of this algebra are 
sums of operators of the type P{x)dy^ ■ ■ ■ 9„„ , where P:V ^ End(F) is a polynomial function. 
We define an antilinear involution * on VDiy, F) by prescribing on the generators that 

m* := my, d* := -dy and A* := A*, 

where A* for A e End(F) denotes the operator adjoint. Then we obtain a natural action of 
VV{V,F) onSL.{F) by 

{P.D,^) := {D,P*.^). 
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Here we use that the elements of VD{V,F) restrict to continuous operators on the Schwartz 
space S{V, F) . In particular we have 

{dy.D,(p) = {D,-dy.ip) and {my.D,(p) = {D,my.ip). 

It is also clear how the algebra VT>{V,F) acts on the space IIol(Tn,F). In this sense we 
obtain directly from the definitions: 

(3.1) T{dy.D) = -imy.T{D), T{my.D) = -idy.T{D) and T{A.D) = A.T{D) 

for V e V and A € End(F) . The preceding relations describe in which way the natural action of 
the algebra P'D{V, F) on S^{F) is intertwined with its natural action on the space Hol(rj2, V) . 
The Fourier transform defines an algebra automorphism J^: VT>(y, F) VV{V, F) which satisfies 
for all P e VV{V, F) and D e S'{V, F) 

(3.2) J^{P.D)=J^{P)T{D). 
Now (3.1) can be written as 

T{dy) = —irriy, T{my) = —idy and ^{A) = A. 



Lie algebra actions 

Recall that we consider G as the universal covering group of Aut(TQ)o- We write Str(Vc) 
for the structure group of the complex Jordan algebra Vc (cf. [FaKo94,p. 147]). Then the natural 
homomorphism H Str(V(c) , coming from the inclusion H C_ G , induces a holomorphic covering 
He Str(Vc)o, where He denotes the universal Lie group complexification of H. The group 
G naturally acts on Tq and 

J:Gx Tn^Stv{Vc)o, {g,z) ^ J{g,z):= 

defines a cocycle (cf. [FaKo94, Prop. XIII.4.1]). Using the simply connectedness of Tq, it is not 
hard to see that there is a unique lifting of J to a cocycle 

J:G xTn^ He with J(l, z) = 1. 

Let (r, F) be a holomorphic representation of He ■ Then we obtain by 

Jr-. GxTn^ GL{F), [g, z) ^ Mg, z): = T{J{g, z)) 

a GL(F) -valued cocycle which leads to a representation of G on Hol(Tn,F) given by 

{7rr{g).f){z) = Mg-\z)-\f{g-\z) for g e G, f eBol{Tn,F). 

For V gV and h G H we obtain in particular the simple formulas 

{7Tr{v).f){z) = f{z - V) and (lTr{h).f){z) = T{h).f{h-\z). 

The derived action of the Lie algebra q on Hol(Tj2, F) is then given by 

{dT:r{X).f){z) = d^Jr{\,z){X).f{z) + {a{X).f){z), 

where &{X){z) := ^ [/=o exp(— fX).z is the holomorphic vector field on Tn corresponding to the 
action of the one-parameter subgroup exp(MX) C G (cf. [Ne99, Prop. IV.1.9(ii)]). 
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Lemma III. 4. The action of g on Hol(Tn,F) is given explicitely by polynomial differential 

operators as follows: 

(i) {v.f){z) = -df{z){v) for V eV '^n+ , 

(ii) (X/)(z) = dT{X).f{z) - df{z){X.z) for X el), and 

(iii) {9iv).f)iz) = 2dT{znv).f{z) - df{z){P{z).v) for v gV, where zDv e str(Fc) = f)c is 
defined by aDb: = L{ab) + [L{a), L{b)]. 

Proof. In this proof we assume that v <= V , X <= i) and h G H. According to [FaKo94, 
p. 209], the vector fields corresponding to the action of q on Tq are given by 

&{v){z) = -V, a{X){z) = -X.z and a{e.v){z) = -P{z).v, 

where the last assertion follows from the fact that the inverion 77: Tq — > To, r]{z) = —z~^ satisfies 
ri{g.z) = 9{g).i]{z) for g gG and z &Tq,. 
We further have 

Jr{v,z) = l, Jr{h,z) = T{h) and Jr{e.v,z) = t{P{v - z'^y'^Piz)-'^). 

Here the first two formulas arc clear from the definitions, and the last one follows from 0(y).z = 
r](v + ri{z)), dri{z) = P{z)^^ ([FaKo94, Prop. II. 3. 3]) and the chain rule. This leads to 
di Ji-(1, z).v = and di Ji-(1, z).X = dT{X) , so that it only remains to verify 

diJr{l,z).9v = 2dT{zDv). 

We have 



diJ{l,z).Ov 



dt 



t=o 



p{z-'-tvr'piz)-' = -p{z-Y'f^ 



t=0 



P{z-^ -tv)P{z-^)-'P{z)-^ 



t=0 



P{z-^ - tv) = 2P{z)P{z-^,v), 



so that the assertion follows from Lemma III. 5 below. 1 

Lemma III. 5. For each z G and u gV we have P{z)P{z~^,u) = zDu. 

Proof. In view of [FaKo94, p. 147], we have for all x,y gVc and g G Str(Vc) the identities 

P{9-x,g-y) = gP{x,y)g^ and {g.xa0{g).y) = g{xay)g~'^. 

For z = g.e we thus get 

P{z)P{z-\u) = Pig.e)P{{g.e)-\v) = gPie)g^P{eig).e,u) 

= gg'^e{g)P{e,g^.u)g-' = gPie, g^ .u)g-' = gL{g'' .u)g-\ 

On the other hand e\2x = L{x) implies 

zDu = {g.e)nu = gieUg'^ .u)g-^ = gL{g'^ .u)g-^ = P{z)P{z-\u). 

Now the assertion follows from = Str(yc)-e ([FK94, Prop. VIII.3.5(i)]). 1 
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The main point in the formulas of Lemma III. 4 is that they show that dwrig) C 'PT>{V, F) , 
acting on IIo\{Tq,V) . We therefore obtain a representation of g on S^{F) by 

X.D ■.= J'-^{d'Kr{X)).D 

and further a representation on C°° (V, F) which on SiV, F) is given by 

(3.3) {D,pr{X).^) = {-X.D,^p) for <f e S{V,F),X & g. 

Remark III. 6. For each linear function a & V* the subspace e" Pol(y, F) C C°°{VtF) is 
invariant under the action of g because this space is invariant under the whole algebra VD{V, F) . 
We will see below that the most important space of this type arises for a = — tr . ■ 

The following lemma makes the action of the parabolic subalgebra n+ x f) C g quite explicit. 

In priciple it is also possible to obtain formulas for the action of n~ = 0(n+) , but it seems that 
this can only be done in coordinates. Fortunately, for our arguments below it will suffice to have 
direct access to the action of f) and n+ . 

Lemma III.7. For (p € C°°{V, F) we have: 

(i) pr{v).ip = —irrivip for w € F = n+ . In particular, pr{U{n'^))-ip = Pol{V) ■ ip. 

(ii) {priX).ip) (X) = dT{e{X)).ip{x) - d^{x).{9{X).x) . 

Proof. (i) We have d-Kriv) = —dy (Lemma III.4(i)), hence J^~^{dTTr{v)) = —iniy, and 
therefore 

{D,pr{v).ip) = -{{-imy).D,ip) = {imy.D,ip) = {D,-imyip) 
because the pairing (•, •) is sesquilinear. 

(ii) Let ui, . . . , t)„ be a basis of V , nij := niy. , and dj := dy^ . Then the differential operator on 
Hol(ro,F) corresponding to X G i) is given by 

n 

{dnr{X).f){z) = dT{X).f{z) - df{z){X.z) = dT{X).f{z) - ( J2 Xjkmkdj.f){z), 
where X.vj — J2k=i-'^kjVk ■ The map !F~^ maps this operator to 

n n 

dT{X) - ^ Xjkidkirrij = dT{X) + ^ Xjkdkrrij, 

1 j.k—l 

and the corresponding action on smooth functions is given by 

n n 

{D,pr{X).(p) = {{-dT{X) - ^ Xjkdkmj).D,ip) = {D,-t{X)* .ip + ^ xjj^rrijdk.ip) 

j,k—l i)fc=i 

= {D,-T{xr.^+dip{-){x*-)). 

We therefore obtain for X G f) the formula 

{pr{X).ip) (x) = -dT{X)* .ip{x) + dcp{x){X*.x) = dT{e{X)).ip{x) - dip{x){6{X).x). ■ 

Prom now on we specialize to the case where F := F{\) and the representation r := 
ta: f) ^ End(F(A)) is t\ := tt\o Cg, where {tt\, F(X)) is a unitary highest weight representation 
of 6c and Cg G Aut(0c) is the Cayley transform (cf. Definition 111.3(b)). 

In the following we equip e"*'' Pol (V, F(A)) with the g-module structure given by the 

representation p^^ of g on C°°(y,F(A)) described in (3.3). 

If is a Lie algebra, then we define a filtration of U{g) by 

W(fl)(") -spanc{Xi-...-Xfc:fc<n,X, eg}, n G No. 

For all n G No we write Pol(y)(") for the space of polynomials on V of degree at most n . 
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Lemma III. 8. There exists a unique isomorphism of i) -modules 

N{X) e- Pol( V) F{X) 

with i>(u) = e-^'v for v e F{X). Morover, i> satisfies $(t/(")(()).i^(A)) = e-*''Pol(y)(")(g)i^(A) 
for all n G No . 

Proof. To prove the existence of $ as a homomorphism of f) -modules, in view of the 
description of iV(A) as a module induced from the (f) fl 6) -module F{X) (Lemma 1.6), it suffices 
to observe that the map 

F{X) ^ e-^'F{X) CC°°{V,F), v^e'^'.v 

is a homomorphism of f) fl 4 -modules. This is an immediate consequence of the fact that the 
function e"*"^ is invariant under H Ci K C Aut(V) because (f) n 6).e = {0}. 

Next we show that $ is injective. Let vi,. . . ,Vm denote a basis of F , so that the Jordan 
left multiplications L{vj) form a basis of f) fl p. And write U{i) n p) for the subspace of U{i)) 
spanned by the ordered products of the form L{vi)''^ ■ ■ ■ L{vm)'^'^ ■ We will use the vector space 
isomorphism 

N{X) ^ U{i)) ^uii,ni) F{X) ^ UH) n p) ® F{X). 
For X e f) and p e Pol{V) (g) F{X) we obtain from Lemma n.7(i) for all u e F the formula 

= dTxieiX)).e-'<y^piy) - iy,X.e)e-'<y^piy) - e-'<yUp{y).{e{X).y). 
Inductively this leads for u = L{xi) ■ . . . ■ L(xn) , Xj & V ^to 

n 

(3.5) $(u(8)u)(y) = e"*''^^^ (^(^ ]^(y, XjOjw + polynomials of order < n^. 

Prom (3.5) we deduce that is injective. 

We also conclude inductively with (3.5) that 

$(ZY(")(f)) (8)F(A)) = e-*^Pol(y)(") (g)F(A) 

for all n e No , and this implies in particular that $ is surjective. ■ 

Remark III. 9. There are several actions of the group H which will be used in the following, 
(a) First we recall the action on Ho1(Tq,F(A)) given by 

{nrih).f)iz) = rxih).fih-\z), 

and on the space C°°{V, F{X)) we consider the action given by 

ih.^)ix) = Tx{e{h)).f{0ih)-Kx) 

which is the integrated form of the representation pj- of f) (Lemma IILT). On the space C°°{V) 

wc consider the action given by {h.(fi)(x) := ip{h~^.x). Via {h.D){ip) := D{h~^.(fi) we further 
obtain an action on 2?'(V, F(X)) which is compatible with the action of t) and given on D (E) v 

by 

{h.{D (S)v),ip(S>w) = {D ®v,h ^.{ip-^w)) = {D ^v,e{h) .ip iS) T\{h)* .w) 
= {0{h).D (^Tx{h).v,(p(Siw), 
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i.e., 

h.{D (g) «;) = e{h).D (g) Txih).v. 
This action preserves the subspace <S^(F(A)), and the Fourier transform 

^:>S^(F(A))^Hol(Tn,F(A)) 

intertwines the /f-actions on both spaces. On the level of the derived representation this is 
satisfied by definition, and on the group level it either follows from the connectedness of H and 
the smoothness of the actions, or directly by calculation. 

(b) Further we consider on the space End(F(A)) the iJ-action given by h.A := Tx{h)ATx{h)* , 
and the induced action on <S^(End(i^(A)) given by 

h.{D^A) = e{h).D®h.A. 

(c) We also have a natural map 

6^ ( End(i^(A))) X C°°(F, F{X)) V'iV, F{X)), {D O A).{>fi <»v)^ipD<» A.v. 

The observation that h.{ipD) = {h.ip){h.D) holds for the multiplication of distributions with 
smooth functions, together with (a) and (b), shows that this map is if -equi variant. ■ 

Theorem III. 10. There exists a unique tempered distribution R\ G <S^ ( End(F(A)) with 

T{Rx){z)=Tx{P{-iz)) for all zGTn. 
This distribution is H -invariant. 

Proof. The existence of Rx follows from [HiNe99, Th. V.8]. The formula P{h.x) = hP{x)h^ 
for h e Str(y) and x ^ V implies that 

J'{Rx){z) = Tx{h)T{Rx){h-\z)Tx{hY for z€Tn,h€H. 

It is easy to see that the action of H on Hol(ro,End(F(A))) given by the formula on the right 

hand side is intertwined by the Fourier transform with the action on iS^ ( End(-F(A))) , so that 
the injectivity of the Fourier transform implies that Rx is fixed by ff . ■ 

Theorem III. 11. (Equivariance Theorem) The map 

f:7V(A) ^<%(F(A)), v ^ RxMv) 

is Q-equivariant, and its range i?^-^ '''^ Pol(V, -F'(A)) is isomorphic to L{X) . 

Proof. Since the Fourier transform S^{F{Xj) Hol(Tn, F(A)) is by definition equivariant 
with respect to the action of g on both sides, it suffices to show that the composition 

jPo*:7V(A) ^Hol(To,F(A)) 

is equivariant. The operator 

Ca:Ho1(I?,F(A))^Ho1(To,F(A)), {Cx.f){z): = Tx[p{^p))).f{{z - ie){z + te)-') 
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intertwines the natural representations of the covering group of Aut(r')o , resp. G, on both spaces 
(cf. [FaKo94, Lemma X.4.4]). The subspacc F{X) , as a ?-modulc is embedded into Hol(7?, F{X)) 
as the subspace of the constant functions, the lowest t-type, and this subspace generates a simple 
highest weight module of g of highest weight A (cf. [Ne99, Prop. XII. 2. 2]). Let c^a > be the 
number determined by tx{j1) = d\l . Then we obtain for v G F{X) C H.o\{T>, F{X)) the formula 

C.(.)(.)=r.(p(ii^)).. = n(il)r4p(i±^)).„ 

= dxT{Rx){z + ie).v = dxT{Rx-v){z + ie) = dxJ^{Rx-e-''v){z). 

This implies that the lowest if -type for the G-representation in Ho1(Tq,F(A)) is given by the 
subspace ^ o \1/(F(A)) which is annihilated by p+ . 

Now the definition of A''(A) as a g-module induced from the p+ x 6c-module F{X) implies 
the existence of a g-equivariant map ^'i:A^(A) Hol(rj2. F(A)) . Its range is the g-module 
generated by o \['(F(A)) which is a simple highest weight module of highest weight A, hence 
isomorphic to L{X) . 

Since Rx is il-invariant (Theorem III. 10), the multiplication map 

e-''Po\{V,F{X))^SL{F{X)), ^ ^ Rx-^ 

is _ff-equi variant (cf. Remark 111.9(c)). Now Lemma III. 8 implies that is ()-equi variant. 
In view of Proposition 1.5, this shows that o maps N{X) = W([)).-F(A) surjectively onto 
ZY(f)).(^ o ^')(F(A)) = L{X) . Therefore T o and ^E"! can be viewed as two [} -equivariant 
linear maps A^(A) ^(A) which coincide on F{X). Now ker(jF o — •^i) is an ()-invariant 
subspace of A^(A) containing F{X), hence coincides with A^(A) (Proposition 1.5). This proves 
that o ^ = is g-equivariant. ■ 

The Equivariance Theorem has several interesting consequences. 

Corollary III.12. (a) The subspace Rx.e-^'Po\{V,F{X)) is a Q-submodule of SL{F{Xj) 
isomorphic to L{X) . 

(b) ker^E* — J(A) is the maximal submodule of N{X) . 

(c) J(A) = {</p G N{X) ^ e- Po\{V, F{X)y. i?A-¥' = 0} . ■ 

Lemma III.13. Let f = YTj=Qfj ^ -^(A) with fj = C^^pj and pj G Pol(V, i^(A)) homoge- 
neous of degree j . Then we have fj G J(A) for all < j < n . 

Proof. Recall that L{e) is the generator of 3(f)) C [) np. From (3.4) we obtain for all 
X G supp Rx ■ 

n 

dpx{L{e).f){x) = -dTx{L{e)).f{x) - {x,e)f{x) + ^ j/,(a;). 

Clearly we have dTx{L{e)).f{x) G C/(x) C J(A), and by Corollary 111.12(c) we also have 
tr-/ G J{X}, so that J2^=ojfj ^ "^W- This means that J(A) is invariant under the operator 
^if) '— X]j=o jfj ' hence adapted to the eigenspace decomposition of E. m 
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IV. Unitary highest weight representations for Cayley type spaces 

In this section we now turn to unitary highest weiglit representations in the setup studied in 
Section II. We will recall the realization of unitary highest weight representations in spaces of 
vector valued square integrable functions on a homogeneous cone. Then we give a new and quite 
explicit characteriztion of the -finite vectors in the cone realization which will easily follow 
from the more general results in Section II. 

We keep the notation from Section III. In particular G is the simply connected covering 
group of Aut(To)o and K and H are connected subgroups of G. 

Let {'JT\,Hx) be a unitary highest weight representation of G with highest weight A G 
it* and with respect to . Wc write (tt^ , F{\)) for the corresponding irreducible Kc- 
representation with highest weight A. Thus Definition 111.3(b) implies that the prescription 
dry. = dn^ o integrates to a holomorphic representation {t\, F{X)) of He . 

Theorem IV. 1. Let Rx G 5^(End(F(A)) denote the distribution with 

C{Rx){z) = Tx{P{-iz)), z&Tn. 

Then the highest weight module L{X) of g is unitarizable if and only if Rx is a measure with 
values in the cone Herm"'"(f (A)) of positive operators on F{X). If this is the case, then the 
following assertions hold: 

(i) Let 

L''{Tl,Rx):={f:Tl^F{X) meas.: J_{dRx{x).f{x), f{x)) < oo}. 

Then the Fourier transform 

J'x:L\n,Rx) ^HxC Hol(To,F(A)), J^x{f){w):= / e'('"'^)rfi?A(a;)./(a;) 

Jn 

yields an isomorphism on the reproducing kernel Hilbert space Tix with kernel 

(ii) If we realize the unitary highest weight representation (tta, T^a) of G in the space L^{ft, Rx) 
as in (i), then the action of the parabolic subgroup V ><> H is given by 

(TTxiv, h).f){x) = e-'^-'-\x{0{h)).f{eih)-\x). 

Proof. For the first statement we have to combine several results. First [Ne99, Th. XII. 2. 6] 
says that L(A) is unitarizable if the natural End(F(A)) -valued kernel on T> is positive definite, 
which by the Cayley transform is equivalent to the positive definiteness of the function tx o P 
on Tq. This in turn is equivalent to Rx being a Herm"'"(i^(A)) -valued measure ([HiNe99, Th. 
V.12], see also [C195, Th. 3.3]). 

(i) [C195, p. 233] 

(ii) This is immediate from [C195, Th. 3.4]. ■ 

The preceding result is the appropriate version of Clerc's results that we need in our context. 
For the scalar case (dimF(A) = 1), similar results were obtained by Vergne and Rossi in [VR76]. 
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Remark IV.2. Suppose that R\ is a Herm"'"(i^(A))-valued measure. Then for each element 
(fi e L'^{Cl,Rx) we can view R\.(p as an element of S^{F{X)) and obtain 

Since the maps and J^x are fl-equi variant, it follows from Lemma III. 7 and Theorem 111.11 
that the action of q on the subspace Z/^(0, R\)°° of smooth vectors is given by the natural action 
on S^{F{X)) . For the subalgebra n+ >^ ^ it is given by the formulas in Lemma III. 7. ■ 

In the following lemma the assumption that L{X) is unitarizable is used to ensure that 
J(A) is a cyclic module. 

Lemma IV. 3. Suppose that N{X) is unitarizable and of reduction level k. Then there exists 
an element Vk G lyl{i)y''\v\\hl{t)Y''^''-\vx such that the maximal submodule J{X) C N{X) is given 
by J{X)=U{\)).Vk. 

Proof. In view of Lemma 111.8, we may identify in the following the () -module N{X) with the 
space e~ Pol(V") ® F{X) . Comparing dimensions in the following chain of inclusions 

(8)i^(A) =Z^(0)("^F(A) D^^(f))(").F(A) = e-*'Pol(F)(") (8)F(A) 

yields equality, so that the assertion follows from Proposition 1.5 and Theorem II. 4. ■ 



Identification on central half lines 

Let A'^ be the highest weight of 7r*o with respect to the Cartan subalgebra t. Then 

r 

(4.1) A° o Cg It, = ^ -^ej with mj - m, e No, i<j 

j=i 

(Definition 111.3(b)). We assume, in addition, that rUr = 0. Then rrij € — Nq for all j. For 
u G M we then set 

A:= A":=A°-uC, 

where C S l]^ is determined by ^ocg |t, = | ej which is equivalent to ^(7) = 1 for 7 e A+ 

long because for the highest root 7 G A+ the corresponding restricted root is e-r with the coroots 
2L{cr) (cf. [Kr99b, Sect. IV]). Then A is the highest weight of a finite-dimensional irreducible 
representation {tx,F{X)) of H which can be written as 

TX = Txo 0T_|£, 

where t-.^^ is a one-dimensional representation. Accordingly, we may identify F(A") for all 
w G C with the fixed vector space Fq: = F{X°) . 

Recall the definition of the Jordan algebra determinant A:= det from [FaKo94, p. 29]. 
For each u G M we denote by i?„ the Riesz distribution with parameter u G C on fl which are 
uniquely determined by 

J^{Ru){z) = Ai-izy, zGTn,u€C 
(cf. [FaKo94, Sect. VII.2]). By a theorem of Gindikin (cf. [FaKo94, Th. VIl.3.2]), i?„ is a positive 
measure if and only if 

we {O,^,...(r-l)^}u](r-l)^,oo[, 

where d:= dim0^(^»+'^^) , i ^ j, is obtained from the restricted root decomposition of g with 
respect to b. Moreover we have supp(i?„) = with i?„(f2\r2) = for it > (r — 1)| and 
supp(i?„) = with Ru(0^\Ok) = 0{ovu = k^,0<k<r-l. 

By a more detailed study of the vector valued measure Rx , one can retrieve useful infor- 
mation on Rx which we collect in the next theorem. 
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Theorem IV.4. If R\n is a HevTD^{F{\^)) -valued measure, then: 

(i) There exists a polynomial map Du- V Herm+(F(A")) with Rx = D^Ru ■ 

(ii) wG{04,...,(r-l)|}U](r-l)f,oo[. 

/•••x /T^ X /T, X foru>(r~l)^ 

(m) suppiR,.) = supp(i?„) = I ^ j,,,^kl,k G {0, . . . , r - 1} • 

Proof. [HiNe99, Th. V.17] 



The space of -finite vectors 

We now determine explicitely the space of JsT -finite vectors for a unitary liighest weight 
representations of G realized in L^(fi, Rx) . Since the if-action in the cone rcahzation is rather 
nasty (cf [DG93]), there is no obvious description of this space. Our approach is based on the 
action of the maximal parabolic subalgebra f) x n"*" which led in Section II already to the right 
subspacc of S^{F{X)). 

Recall the decomposition of the ring Pol(y) of polynomials into irreducible ff-modules 
(cf [FaKoQO, Th. 2.1], [FaKo94, Th. XI.2.4]): The if -decomposition is muliphcity free and given 

by 

(4.2) Pol(y) = Pol(y)^ 

m>0 

where m = (mi,...,mr) and the condition m > means that TOi > m2 > . . . > > 
and rrii e Z. The space Pol(V^)m is a real highest weight module of H with highest weight 
Am = Yl'j=i ''^j^j G ^* w.r.t. — E+ which is generated by the highest weight vector Am (for the 
definition of the generalized power functions Am we refer to [FaKo94, p. 122]). 

Recall that the Jordan algebra trace tr on V satisfies tr(a;) = (x, e) for all x gV . 

Theorem IV. 5. (Description of ii'-finite vectors) Suppose thai {nx,Hx) is a unitary high- 
est weight representation of the simply connected hermitian group G of tube type realized as 
L'^{Q,Rx)- Then the space L'^{Q,, Rx)^ of K -finite vectors of (ttxtHx) is the image of the space 
e"*'' Pol(y, i^(A)) in L'^{fl,Rx), and a highest weight vector of (ttajHa) is given by the function 
e~^''.vx, where vx is a highest weight vector of {tx,F{X)). 

Proof. We identify L'^{Q,,Rx) with the subspace 

Rx.L\Tl,Rx)CS^{F{X)) 

which is compatible with the -action on the space of smooth vectors, because the Fourier 
transform 

T: Rx.L^U, Rxr ^ Hol(rn, F(A)) 

is fl-equivariant (cf Remark IV. 2). 

Since Rx is a tempered distribution, all restrictions of the functions in e"*"" Pol(V, F(A)) 
arc contained in £"^{^1, Rx) ■ In view of Theorem III. 11, the subspacc Rx-e^*"" Po\(V, F{X)) is a 
fl-module isomorphic to L{X), hence contained in L^{Q,Rx)°° , and therefore in L?{il,Rx)^ ■ 
On the other hand, the fact that the representation of G on L^{il,,Rx) is a unitary highest 
weight representation implies that L^(fi, Rx)^ is a simple g-modulc, which yields equality. The 
description of the highest weight vector follows from Theorem III.ll. ■ 
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In the scalar case Theorem IV.5 has been proved by completely different methods by 
J. Faraut and A. Koranyi (cf. [FaKo94, Prop. XIII.3.2].) 

For every 0<fc<r — 1 we write 

h := Pol{VU = {/ e Pol(V^): / \o, = 0} 

for the ideal defined by Ok ■ For the asserted equality, we note that the ideal defined by Ok is 
if -invariant, hence adapted to the if -decomposition (4.2) of Pol{V) . Therefore one only has to 
note that for m > the function Am vanishes on Ok if and only if mk+i > (cf. [HiNe99, 
Prop. 1.4]). 

The following proposition provides a description of the maximal submodule J(A) C A''(A) 
in the picture of Theorem IV.5. 

Proposition IV. 6. Suppose that L{X) is unitarizable and write Rx = D^Ru with the 
polynomial density function Z)„. Identifying N{X) with e~*'^Pol(V, F(A)), we have 

J(A) = {e-*7 G iV(A):£)„./ = on supp(ii„)}. 

For A = A" , u = , fc G {0, . . . , r — 1} , we obtain in particular J(A) 3 e~ (g) i^(A). 
Proof. In view of Theorem IV.5, the natural 0-contravariant hermitian form on 

Ar(A) ^e-*^Pol(V,i?'(A)) 

is given by 

{e-"^f,e-"^g) = j_e-^'<-\dRx{x).f{x),g{x)) = [_e-^"^^-\Du{x).f{x),g{x))dRu{x). 
Jn Jn 

This implies the assertion because J(A) = {e"*''/ G N{X): (e~*''/,e~*''/) = 0}. 

For the special case described in the second part of the statement, wc only have to observe 
that supp(iZA) = Ok which implies that Rx.e~^'^Ik d) P{X) = {0} in this case. This completes 
the proof. ■ 



V. The classification for Cayley type spaces 

In this section we give an explicit description of the if -fixed distribution vector of a spherical 
unitary highest weight representation (tta, Ti-x) of a simply connected hermitian group G of tube 
type (cf. Theorem V.l). In the case where supp(i?A) is smaller than fl our approach yields a 
complete classification of all spherical unitary highest weight representations of G . 



The iJ -invariant distributions 

In this section we assume that (TA,i^(A)) is a if n if -spherical representation of if. In 
view of the Appendix A in [HiNeQQ], this means that it can be viewed as a real highest weight 
representation with respected to the restricted root decomposition of I) with respect to b . We 
write 

(5.1) X = X^:=j2^ej 
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with mi < . . . < rufc < ruk+i = . .. = rrir = and s G M . Then the corresponding representation 
satisfies tx^ = txo (g) det~^^'^''° ^ (cf. [HiNe99, Sect. I]), so that we may identiiy all the spaces 
F{X') with Fo := -F(A°). 

According to [KNOQT, Th. 11.11], there exists for each vq G F(A*)'"^' ^ F^'^^ a unique 
if -invariant holomorphic function 

UTn^F{X') with fsiie)=vo. 

Note that the iJ-invariance of / with respect to the action {h.f){z) = Tx^{h).f{h~^.z) means 
that / is an iJ-equivariant map. The uniqueness of / is a direct consequence of the fact that / 
is uniquely determined by its restriction to iO, = H.ie C Tq . 

Theorem V.l. There exists a weakly holomorphic map C <S'(F, F(A°)), s h-* R^, with 
T{Rxs ) Ito = fs o,nd is supported by O . Suppose that 

mi < . . . < ruk < TOfc+i = . . . = rrir = 0. 

Then the tempered distribution R^^ is a measure if and only if 

|G{fc|,...,(r-l)|}u](r-l)|,oo[. 

// this is the case, then 

R^s = {§)zlvRi, 

where 

r -m,-l k -m,-l 

(i)-'"=n n (i-o-i)^O-n n (i-(^-i)^O' 

j=l 1=0 j=l 1=0 

r]:V ^ F{X^) is a polynomial map with r]{g.e) = Txo{0{g)).VQ for g G H , and Rg , s G C, are 
the Riesz measures on Q with T{Rs){z) = A{—iz)~^. 

Proof. The existence of the weakly holomorphic family R^^ , s G C, follows from [HiNe99, 
Prop. V.2]. The characterization of those parameters for which R^s is a measure is a consequence 
of [HiNeQQ, Props. III.8 and V.5]. That the density ?7 is a polynomial follows from [HiNeQQ, Props. 
II.8]. ■ 

Remark V.2. (a) The polynomial (f)-m vanishes in the points of the form (j — 1)| , where 
^ < j < k and < Z < —nij — 1 . Therefore the maximal zero is s = (A; — l)d, which is the place, 
where the distribution no longer is a measure. The values s = jd correspond to measures 
on the boundary components Oj , k < j < r — 1 . For j < k the density function 77 vanishes on 
Oj ([HiNe99, Prop. 11.12]), which somehow cancels with the zero of (|)-m, but the resulting 
distribution is not a measure. 

(b) Since the Fourier transform T: Sj^{V, F{X)) — > Hol(ro,F(A)) is injective and equivariant 
with respect to the i7-actions on both sides (Remark III. 9), the uniqueness of an if -invariant 
holomorphic function implies that 

dimS^{V,F{X))" = 1. m 

Let F{X) be a spherical -representation with highest weight A and ^ vo & -F(A)^'^* . We 
have seen in the preceding section that there exists a unique if -invariant tempered distribution 
i?f G SL{V,F{X)) with J'iR^Xie) = vq. 
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Lemma V.3. The prescription 

v. N{X) ^ Pol(y, F{X)) C, e-*7 ^ (^f , e-*7> 
is a non-zero element of (iV(A)'')'' . 

Proof. It follows from [HiNe99, Lemma B.l] that v is well defined because e"*'' |jj extends 
to a Schwartz function on V . Finally v is annihilitad by f) since is iJ-fixed. ■ 

Corollary V.4. L{X) is spherical if and only if {Rx , JW) = {0}- ■ 



The classification of unitary highest weight modules with spherical F(X) 

Let 7i, . . . ,7r G A+ be a maximal system of orthogonal roots, where 7^ is the highest 
root and 7j_i is maximal among all positive non-compact roots orthogonal to 7^, . . . ,7^.. Then 
a linear functional A G il* is invariant imder (— r) if and only if A £ span{7j:j = l,...,r} 
because the real rank of q equals r (cf. Definition 111.3(b)). Therefore it is of the form 

Since 7j o Cg |[, = Sj e b* , we have 

A, :=Aocg|,=^^.,. 
i=i 

That F{X) is a t) n 6-spherical highest weight module of t is equivalent to — r.A = A and 
the condition that Ab € b* is the highest weight of a spherical representation of t) which is 
equivalent to 

(5.2) A(7,) - A(7i) e 2No for i<j 

(cf. Definition in.3(a)). For A = A" as in (5.1) this means that mj — A(7j). 

The following theorem shows that the classification of unitary highest weight modules with 
spherical F{X) is much simpler than the general case. 

Theorem V.5. // F{X'^) is i) Ci t- spherical, At, = J2^=i^^j > ^''^'^ ^ ^ {0, — 1} is 
determined by mi < ... < < mk+i = . . . = irir, then 

1{X^) = {kd, {2k + 1)^, ...,{k + r- l)^}u] {k + r- 1)^, 00 

Proof. First [EJ90, 6.6] implies that 1{X°) = {uq, . . . , Um}^]uTn, oo[ with m = r — k — 1, so 
that it remains to determine uq . 

Let u := uq. To compute this parameter, we recall from [EJ90] that le(A) = 1 , and that 
the highest weight of J(A) is given by the unique dominant integral functional /io conjugate 
to A — 7r under the Weyl group of . Since in our context A and can be identified with 
elements of b* and the Weyl group contains in particular the permutations aij for two element 
7j and 7^ , it follows that 

Mo = crr,fe+l-(A - 7r) = A - 7fe+l. 
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That this functional is dominant is a consequence of the fact that nik+i — 2 > ruk which follows 
from (5.2). 

To calculate uq, we use the fact that iy(A"°) and i(/xo) correspond to the same eigenvalues 
of the Casimir operator of g , which implies that 

l|A + pf = ||A.o + pf = ||A + p-7fc+if 

for p: = 5 J2aeA+ ^' "^^^^ means that 2(A + p, Jk+i) = ||7fe+i|P which is the same as 

(A + p)(7fc+i) = l. 

Since A(7fc+i) = X{jr) = -uq, we obtain uq = p(7/c+i) - 1. 

To compute this number, we first observe that it equals one half of the trace of 7^+1 on the 
positive root spaces in gc- Since %+i corresponds to the clement 2L{ck+i) under the Cayley 
transform, the contribution of the non-compact root spaces is given by 

try L(cfe+i) = (r- 1)^ + 1 

(this is a consequence of the Peirce decomposition of V; see [FaKo94, Th. IV. 2.1]). The 
contribution of the compact roots equals 

i ^ (dimf,")a(2X(cfc+i)) = ^ 5^(s, - s,mck+^)) = ^{k - {r - k - 1)) = {2k-r + 1)^. 
Summing up, we obtain 

Wo = p(7fe+i) - 1 = (r - 1 + 2fc -r + 1)^ = fcrf. ■ 



Support properties 

Lemma V.6. Let D G S'(y) be a tempered distribution whose support is contained in fl. Let 
further I C Pol(V^) be an ideal such that {D,e~^''I) = {0}. Then 

supp(D) C{x€V: (V/ € I)f{x) = 0}. 

Proof. Since D is supported by fi, the product De~^^ defines a tempered distribution on V 
(cf. [HiNe99, Lemma B.l]). Let / G J. We claim that fD = 0. For all polynomials p € Po\{V) 
we have 

On the other hand, the Fourier transform T{fD) G Hol(Tn) (cf. Section II) satisfies 

(p{^^HfD)){ie) = {fD,e-'^p{i-)) = 0. 

Since T{fD) is a holomorphic function on Tn and p was arbitrary, we conclude that J^{fD) = , 
and hence that fD = 0. This implies that supp(£)) C /~^(0) ([HiNeQQ, Lemma B.4]), hence 
yields the lemma. ■ 
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Lemma V.7. Let D e S'{V) (g) F{X) be a tempered distribution whose support is contained in 
Q. If 

{D,e-''h®FiX)) ={0}, 

then supp(£') C Ok ■ 

Proof. Let a G F{X)* . Our assumption implies that (a o D, e~^^Ik) = {0}, so that Lemma 
V.6 impUes that then supp(a o D) C Ok ■ Since a was arbitrary, the assertion follows. ■ 

Proposition V.8. // L(A) is unitarizable and spherical, then supp(-R^) C supp(iZA)- 
Proof. If supp(i?A) = f^, there is nothing to show. So we may assume that u = and 
supp(i?A) = Ofc (Theorem IV.4). Then 

e-'^Iki^FiX) C J(A), 

so that the assumption that L{X) is spherical implies that vanishes on this space. Hence 
the assertion follows from Lemma V.7. ■ 

As the preceding proposition suggests, information on the support of might provide 
information on whether L{X) is spherical or not. 

Proposition V.9. About the support of the distributions R^ , X = X" , we have the following 
information: 

(i) If s = jd, j e {k, . . . ,r — 1} , then Rf is a measure supported by Ok for which Ok-i is 
zero set. 

(ii) If s > (r — l)d, then R^ is a measure supported by Q for which dil is a zero set. 

(iii) // s ^ {0, . . . , (r — l)d} — 2No and s < {r — l)d, then R^ is not a measure and its support 
is all of O . 

(iv) If s = jd — 2m with m S N and j G {k, . . . , r — 1} , then supp(i?;^) C Oj . 
Proof. (i) follows directly from Theorem V.l and [HiNe99, Prop. IILG]. 

(ii) This is a consequence of the fact that the density of R^ with respect to the il-semiinvariant 
measure i?| on Q docs not vanish anywhere. 

(iii) In view of the relation 

A^Rs = {s)iRs+i, seC,/GN 
([HiNe99, Prop. III.l]), we obtain for s > (r - l)d the relation 

Since both sides are weakly holomorphic functions with values in S'(y,Fo), we conclude 

that 

(5.3) A'iJf, = {'-)iR^s+., 

holds for all s e C. Now the hypotheses shows that (|); ^0 for any I gNq- Therefore (i) and 

(ii) together with (5.3) imply that fl C supp(i?|^,), hence equality. 

(iv) From the proof of [IIiNe99, Prop. V.2] wc get 

so that (iv) follows from (i). ■ 

The situation is particularly simple for A° = 0, where A; = 0, so that Proposition V.9 gives 
complete information on the support of R^s = i?| . Fortunately the classification in Theorem 
V.5 shows that the information from Proposition V.9 suffices to deal with all those distributions 
R^ for which F{X) is spherical and L(A) is unitary. This is made precise by the following result: 
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Proposition V.IO. Suppose that -F'(A°) is i) (1 t-spherical and that L{X) is singular and 

unitary. Then the following assertions hold: 

(i) is a measure if and only if le(A) is odd. 

(ii) If u = with j <r — 1 odd, then does not vanish on e~^^Ij ® F{X) . 
Proof. (i) Let A = A"^ . Then le(A) = j + 1 and ^ = {k + ^)^ (Theorem V.5). Since 

Ui r — k — l.d r + k — ld , ^.d 

— < (k-\ ) - = < (r - 1)-, 

2-^ 2 ^2 2 2-^ '2 

the coroUary follows from Proposition V.9(i). 

(ii) The ideal Ij contains in particular the polynomial Aj+i for j + 1 = ( 1, . . . , 1 , 0, . . . , 0) , 

(j+l)— times 

SO that it suffices to show that 

where v\ G F{X) is a real highest weight vector for f) with highest weight Ab = J2i=i "V" ^^' 

Let s {si, . . . ,Sr) & C'^ and Rs & <%(C) the multiparameter Riesz distribution which is 
uniquely determined by 

T{R^){ix) = As(x"^) for x&n 
(cf. [FaKo94, Ch. VII]). Now [HiNe99, Lemma V.4] yields 

= {vo,vx)R^. 

On the other hand we have 

Aj+i.i?ii^ = ( — - — )j+i-R:i^+j+i 

with 

1=1 

([HiNe99, Prop. Ill.l(iii)]). This eventually leads to 

(i?f,e-*'-Aj+i«A) =^(Aj+i(iif,^;A))(-ie) = (^i^)_,+iA_^.^^(e)(t;o, «a) 
= ( 2 )j+i\^0'^^)- 

Since (uq, v\) ^ (cf. [HiNc99, Lemma II.l]), it remains to show that ( "^'" )j+i does not vanish 
if j is odd. In view of m; = for I > k, we have 

n {^-"-4)- n -('-!))#»- 

l=k+l l=k+l 

For I < k we use j > 2k (Theorem V.5) to obtain 

-m, + |-(Z-l)^>|-(/-l)^>^(fc-(Z-l))>0. 
Therefore all factors in ( "~^"' )j+i are non-zero. ■ 
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Theorem V.ll. (Classification for singular supports) Let G be a simply connected hermitian 

Lie group of tube type and G / H an associated symmetric space of Cayley type. Suppose that 
F{X) is () Di-spherical and that L{X) is unitary with supp(i?;^) ^ fi. Then L{X) is spherical if 
and only if le(A) is odd. 

Proof. Since supp(i?A) is smaller than Q, we have u — for some j < r — 1 (Theorem 

IV. 4). Moreover, in view of Remark II. 3, Theorem V.5 shows that le(A) is odd if and only if j 
is even. If this is the case, then L{X) is spherical by Theorem II. 8. If j is odd, then Proposition 

V. IO shows that R,^ docs not vanish on e~^'^Ij (8) ^"(A) which is contained in J(A) (Proposition 
IV. 6). Therefore Corollary V.4 implies that L{X) is not spherical. ■ 

Corollary V.12. (Classification for the scalar case) // L{X) is singular, unitary and of scalar 

type, then L{X) is spherical if and only if lc(A) is odd. 

Proof. In the scalar case F{X) is always H n /sT -spherical and A is singular if and only 
supp(i?A) 7^ fi- Therefore the assertion follows from Theorem V.ll. ■ 

Lemma V.13. // L{X) and L{ii) are unitary and spherical, then the same holds for L{X + ii). 

Proof. Since L{X) and i/(/x) are unitary, the highest weight module L{X+fi) can be embedded 
into the unitary module L(X) ® L{fi) as the submodule generated by wa ® , where v\ and 
Vfj. are highest weight vectors ([Nc99, Prop. IX. 1.15]). It follows in particular that L(A + ^) is 

unitary. Moreover, if vx G (L(A)'')'' and t'^ € (L(/i)'')'' are non-trivial f) -invariant antilinear 
functionals, then ux (S) I'/j, is an f) -invariant antilinear functional on L{X) (g) i/(/x) with 

<S) i^ij.){vx (8) Vfj,) = i^x{vx)i^fi{Vfj,) ^ 

(Proposition 1.5). This shows that the restriction of vx ® ^p. to L(A -|- \x) is non-zero and hence 
that this module is spherical. ■ 

Remark V.14. Let uo = kd as in Theorem V.5. Then Theorem V.ll shows that L(A) is 
spherical for u = uj = kd + j^ if j is even (which corresponds to odd reduction level) and not 
spherical if j is odd, provided uj < (r* — 1)|. This means that 

j <r-l-2k. 

For an odd j G {r — 2k, . . . ,r — k — 1} Theorem V.ll gives no information. 

Suppose that for some j the module i(A"^ ) is spherical. We know from Corollary V.12 
that L{dQ is spherical, so that Lemma V.13 and 

Xuj+2 = x^^i + dC 

imply that L(A"^+^) is spherical. This argument can be iterated, and it shows that if for one 
odd value of j the module i(A"-') is spherical, then it is true for all larger (odd) values of j. ■ 

We have already seen in CoroUar V.12 that for singular support of Rx and even reduction 
level the scalar type highest weight modules are not spherical. It is instructive to observe that this 
in general not ruled out by the support condition in Proposition V.8. The following proposition 
shows that the support behavior is actually quite complicated. 

Proposition V.15. For s > {r — 1)| we always have supp(i?|) C supp(i?s). For s = 
fc G {0, 1, . . . , r — 1} we have: 

(i) // k is even, then supp(i?|) C supp(i?s). 

(ii) // k is odd, then we have: 



Unitary spherical highest weight representations 27 

(a) If d= 1,2, then supp(i?|) ^ supp(i?5) . 

(b) If d = i, then supp(i?|) C supp(i?s) . 

(c) If d — 8 and r — 3, then supp(i?|) C supp(i?s). 

(d) If d ~ n — 2 and r ~2, then supp(i?|) C supp(i?s) if and only if n = 2 mod 4. 

Proof. (i) This follows from supp(i?j) = Ok Q Ok = supp(i?s). 
(ii) (a) d = l: Then 

kd k , ^ , 

because k ^ 2jmod4 for each j . Hence Propositfon V.8 implies that 

supp(i?|) = f2 2 supp(i?s) 

in this case. 

d = 2: If A; is odd, then 



kd k 
T ~ 2 



= o ^ {Ji-j = 0, . . . ,r - 1} - No = = 0, . . . ,r - 1} - No 



because | is not an integer, 
(iii) d = A: If k is odd, then 



kd 

T 



= fc e {if :i = 0, . . . ,r - 1} - No = {2j:j = 0, . . . , r - 1} - No 



and the minimal j with k G 2j — No is given by j = < k . We conclude that in this case we 

always have supp(i?|) C Oj C Ok = supp(i?s). 

(iv) d = 8 and r = 3 : Then k odd implies that A: = 1 . Now 



kd 

_ = 2 = 4 • 1 - 2 G {if : J = 0, . . . , r - 1} - No = {4j: j = 0, 1, 2} - No- 



Hence supp(_R|) Q Oi = supp(i?s). 
(v) d = n — 2 and r = 2: Then k = 1 and therefore 

kd n — 2 , . „ r .A . „ ^, r„ n — 2 



e J = 0, . . . , r - 1} - No = j = 0, 1} - No = {0, -—} - No 



is equivalent to 

n — 2 n — 2 n — 2 

= e N. 

2 4 4 

Thus supp(i?|) 2 supp(iis) for n ^ 2 mod 4, and for n = 2 mod 4 we have supp(i?|) C £)i = 
supp(i?s). ■ 

Example V.16. We consider the Lie algebra g = su(r, r) corresponding to the Jordan algebra 

V = Herm(r, C) . Here f) = R © s[(r, C) , which wc consider as a quotient of g[(r, C) modulo zR. 
This is most natural because Q[{r, C) acts naturally on V by X.A = + AX* , and the kernel 
of this representation is iM. . The complexification of f) is 

[)c = C©sl(r, C)©sl(r, C) 
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which we consider as a quotient of gl{r,C) ® fl[(r, C) acting on Vc = End(C'') by {Xi,X2).A = 
X\A + AX2 . Accordingly we write the highest weights of simple modules as 

A = (Ai,...,A2r) = (A+,A-) 

with respect to the positive system 

= {ej - Sj-: 1 < i < j < r; r + 1 < i < j < 2r} 

of roots of s[(r, C) si{r, C) . 

The corresponding representation space F{\) has the structure 

F{\) = F{X+) <g> F{X-) = F{X+) F(x-y ^ Hom(F(A-), F{X+)), 

where A~ = (— A2r, • • • , — A^+i) . The action of i) on this space is given by 

X.A = Trx+ {X)A + A7Tj_ (X)*. 

Therefore a fixed vector for F) n t = su(r, C) corresponds to an intertwining operator for 5u(r, C) , 
and hence for s[(r, C) , in Hom(F(A^), F(A+)) . This means that F{X) is spherical if and only if 
F(A+) = F(A-) as s[(r, C) -modules. With fi := A+ we therefore get F(A) ^ End(F(/i)) with 
sl{r, C) acting by X.A = 7r^(X)A + A7r^(X)*. 

The restricted highest weight of this representation with respect to the subspace b of real 
diagonal elements in I) is given by 

r r , , 
■^b = ^'^J - 2 ^' 

The normalization rrir = leads to Ai = X2r , and for the spherical representations further to 

r 

Ab = ^ Xr+l-jEj 

because A+ = — A~ in this case. We determine fc e {0, . . . , r — 1} by Ai = A2 = . . . = Xr-k > 
Xr-k+i- Then Theorem V.5 implies that m = r — 1 — k and uq = 2A; because d = 2 holds for 
g = su(r, r) . 

It is interesting to observe that the relation F{X) = End(F(/x)) as representations of H 
implies that o P:Ta End(F(/Lt)) is 7? -equi variant, so that the injectivity of the Fourier 
transform implies for vq = 1 £ End(F(/Lt)) the relation 

where is interpreted as a module of [)c which is trivial on the second s[(r, C) -factor. It 

has been shown by J. L. Clerc in [C195] that for these representations L{ii) is unitary if and only 
if § e {fc, fc + 1, . . . , r — 1} or u > (r — 1) . According to Proposition V.8, these are the cases 
where i?^ = is a measure, and they correspond to the cases with odd reduction level. Then 
the unitary g-module C End(L(/x)) contains a g-submodule isomorphic to L{X) , 

and the trace is an 1^ -invariant linear functional on L{X) . This construction can also be used to 
prove that the representations L(A) are spherical for odd reduction levels. ■ 

Our results in this section suggest that for even reduction level a singular highest weight 
representation is never spherical. At least we do not know of any counterexample. 

Similarly, in all cases of singular representation where we could decide whether L(A) is 
spherical or not, this happens if and only if the distribution is a measure. In the scalar case 
this follows from Proposition V.9 and Theorem V.5. 
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Appendix: Regularity of the holomorphic discrete series 

In this appendix we show that the highest weight modules L(\) corresponding to the 
discrete series of a compactly causal symmetric space G/H are regular in the sense that iV(A) = 
L{X) . This shows in particular that these representations do not provide any further information 
on sphericalness of singular highest weight representations. 

Let be a hermitian Lie algebra, t C g a compactly embedded Cartan subalgebra and 
A = A(0c,tc) the corresponding root system. We choose a positive system A+ of A as in 
Section I and set p: = i EseA+ P''- = 5 SSeA+ " = 5 ESeA+ ^• 

If A G it* is dominant integral w.r.t. A^ , then the condition for L{X) to correspond to 
the relative holomorphic discrete series of G is given by Harish Chandra's condition (cf. [HC56]) 

DS{G) (Va e A+) (A + p,a)< 0. 

Elementary algebraic considerations involving the Parthasarathy inequality (cf. [EHW83, Prop. 
3.9]) or [Jan79,p. 35] imply that DS(G) implies that A is regular, i.e, iV(A) = L(A). 

Equip now g with an involution r such that (0,t) becomes compactly causal. Recall the 
root system A = A(fl'',a). The fact that 3(6) C q implies that we can choose A+ such that 
-tA+ C A+Ua-^. Then A+:= A+ |o\{0} is a positive system of A. Recall the definition of A+ 
and A^ from Section I. Set p: = 5 EaeA+ maU, pk'. = \ EaeA+ "^""^ Pn- = 5 J2aeA+ "^"O! 
with rua = dim(g'^)" . 

Let tc ^ ac denote the orthogonal projection with respect to the Cartan-Killing form. 
Then the adjoint map p*-a^ is injective and via this inclusion mapping we identify in the 

sequel with a subspacc of . 

For a if nJsT -spherical highest weight A G a* C ii* the condition for L(A) to belong to the 
relative holomorphic discrete series of G/H is given by 



DS{G/H) (Va G A+) (A + p, a) < 

(cf. [0091], [h6091]; see also [Kr99b]). It follows easily from the fact that A+ and A+ are 
compatible that DS{G/H) implies DS(G). Conversely it was observed in [0088, Lemma 7.4] 
that DS{G) is a weaker condition than DS{G/H) for if nii' -spherical highest weights A. Hence 
the following result is of interest. 

Theorem A.l. Let Ago* he dominant integral for A^ and assume that DS{G/H) holds. 
Then A is regular, i.e., L{X) = N{X). m 

We are going to give a simple algebraic proof of Theorem A.l using the Parthasarathy 
inequality. 

Lemma A. 2. We have Pn= Pn- 

Proof. This follows from p„ G ^3(6)* , 3(6) C and A+ |„ C A+ . ■ 
Lemma A.3. //Ago* and p G it* , then 

\\X + p\\' - 11/^ + Pf = l|A + pII' - ll/x + pf - 2{pk - pk,p). 
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Proof. By Lemma A. 2 we have 

l|A + pf - IIm + Pf = l|A + p + {p-pW -U + P+ {p-pW 
= ||A + p+ (pfe -/9fe)||^ - Wli + p + {Pk - Pk)\? 
= ||A + pf + 2(A + p, pfe - pfe) - ll/x + pf - 2(/x + p, pfe - pfe) 
= ||A + pf - ||/x + p||2-2(/i,pfe-pfc), 

where the last equality comes from p/c — pfc € 0"*" . ■ 

Lemma A. 4. M^e have Pk ^ Pk + pI with p^: = i X^agA+na^ a G a-"- . 

Proof. Let a E and rewrite a as a = ctq + ctf, with ttq = a Imq a-nd «(, = a |tnfi • Assume 
that ttq 7^ 0. Then (— t).A^ C U a"*" and the fact that A^ and A^ are compatible yield 
—T.a = aq — «(, G A^. Hence we get 



i ^ a = Pfe 



2 



Now the assertion of the lemma follows from Pk = 2+ '-^ ~^ Pk- ■ 

k 

Proof of Theorem A.l. In view of Parthasarathy's condition (cf. [EHW83, Prop. 3.9]), we 

only have to check that 

||A + p||2-||^ + p||2<0 

holds for all -highest weights 7^ A of N{X). Note that n can be written as = A — 
J2aeA+ with ka € No . By Lemma A. 2 we then have have 

||A + pf - IIm + pf = ||A + pf - ll/i + pf - 2(pfc - pfc, /i) 

= -|| ^ fcaaf + 2( fca(A + p,a)) -2(pfc-pfc,p). 

In the bottom line the first summand is clearly negative, the second one by assumption, and 
the non-positivity of the third one follows from Lemma A. 4 since p is dominant with respect to 
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